Fluctuation theorem for entropy production at strong coupling
Xu Y Y1, †, Liu J2, Feng M3, 4, ‡
Faculty of Science, Kunming University of Science and Technology, Kunming 650500, China
Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Kunming 650500, China
State Key Laboratory of Magnetic Resonance and Atomic and Molecular Physics, Wuhan Institute of Physics and Mathematics, Chinese Academy of Sciences, Wuhan 430071, China
School of Physics and Microelectronics, Zhengzhou University, Zhengzhou 450001, China

 

† Corresponding author. E-mail: xyynx1981@gmail.com mangfeng@wipm.ac.cn

Project supported by the National Natural Science Foundation of China (Grant Nos. 11674360, 11734018, 11835011, and 11965012) and the Applied Basic Research Project of Yunnan Province, China (Grant No. 2017FB004).

Abstract

Fluctuation theorems have been applied successfully to any system away from thermal equilibrium, which are helpful for understanding the thermodynamic state evolution. We investigate fluctuation theorems for strong coupling between a system and its reservoir, by path-dependent definition of work and heat satisfying the first law of thermodynamics. We present the fluctuation theorems for two kinds of entropy productions. One is the informational entropy production, which is always non-negative and can be employed in either strong or weak coupling systems. The other is the thermodynamic entropy production, which differs from the informational entropy production at strong coupling by the effects regarding the reservoir. We find that, it is the negative work on the reservoir, rather than the nonequilibrium of the thermal reservoir, which invalidates the thermodynamic entropy production at strong coupling. Our results indicate that the effects from the reservoir are essential to understanding thermodynamic processes at strong coupling.

1. Introduction

Fluctuation theorems (FTs) are applied to explaining thermodynamic behaviors of microscopic or macroscopic dynamics in a system away from thermodynamic equilibrium.[14] In particular, since Jarzynski’s proposal for an equality between the non-equilibrium work and the free energy difference,[5] there has been increasing attention on the fluctuations regarding different thermodynamic quantities.[68] One of the famous FTs was proposed by Crook to connect the probability of an entropy production (EP) along the forward trajectory with that along the reverse one.[9] Subsequent developments have extended the conditions in Ref. [9] to more general situation, such as the differential FT[10,11] for the joint probabilities of EP regarding arbitrary initial and final generalized coordinates. This generalized FT was also verified experimentally by an optically levitated nanosphere[12] and generalized again to the case with arbitrary measurements and feedback.[13] Recently, the EP was also extended to analyzing the elliptical thermal cloak.[1416] Moreover, the FT itself was quantized,[1719] although definitions of work and heat in quantum systems are still in debate.[20] Meanwhile, experimentally verifying the Jarzynski equality was also extended from the classical consideration[2123] to the quantum counterpart by trapped ions.[24,25]

In this work, we consider a thermodynamic system interacting strongly with its reservoir, which is recently a hot topic[2630] for both quantum and classical systems. The effects of strong coupling in equilibrium thermodynamics were first considered by the potential of mean force.[31] The associated problems include identification of work and heat in the strong coupling case[2729] and estimate of the strong coupling effects on the energy transfer.[26,30] For example, the internal energy was defined by the potential of mean force, and work and heat were assumed to be associated with the change of the corresponding states of the system, from which FTs of the EP were obtained.[27,28] Such a definition of work and heat was also applied to another publication for the Jarzynski equality at strong coupling.[32]

This paper focuses on the FT of informational EP through microscopic reversibility. We also explore a generalized FT of thermodynamic EP in the case of a strong system–reservoir coupling based on a trajectory-dependent definition of work and heat. In this generalized FT, new terms originated from the effects of reservoir appear. Discussion is made for avoiding violation of the second law of thermodynamics at strong coupling by justifying the FT of the informational EP.

2. Redefinition of thermodynamic quantities

We consider an isolated composite system comprising a system and its reservoir, whose Hamiltonian is given by

where Hs is the Hamiltonian of the system driven by the control parameter λ, Hr is for the reservoir, and HI is regarding the system–reservoir interaction. Here the strong coupling implies either a system–reservoir interaction comparable to other characteristic quantities in the Hamiltonian or non-Gibbs state in the system or reservoir. In fact, there exists correlation between the system and reservoir when the composite system reaches an equilibrium state. In our protocol, the control parameter is designed as λ0λ(t) → λ for the forward process. The interaction Hamiltonian is generally written as . For simplicity, here we reduce it to HI = Θs Θr. Moreover, z = (x,y) means the point in the total phase space Γ = ΓsΓr, with Γs and Γr being the phase spaces of the system and its reservoir, respectively.

As a comparison, we first check the definition in the weak coupling case. In terms of stochastic thermodynamics, the fluctuating internal energies (or called internal energies on the trajectory level) of the system and its reservoir are defined, respectively, as es = Hs(x,λ) and er = Hr(y),[34,35] in which the interaction energy is excluded from both the internal energies. We argue that such a definition can be reasonably extended to the case of strong coupling based on the fact that the interaction energy belongs neither to the system nor to the reservoir, but comes from the coupling in between.

Considering the difference from the weak coupling, we need to redefine work and heat on the trajectory level. To this end, we may first check the corresponding definitions on the ensemble level, which are given by the ensemble average for the fluctuating quantities, e.g., Us = ⟨Hs(x)⟩s (Ur = ⟨Hr(y)⟩r) as the internal energy of the system (reservoir), where the ensemble average means ⟨Hs(x)⟩s = ∫ps(x)Hs(x)dx (⟨Hr(y)⟩r = ∫ pr(y)Hr(y)dy) with px(x) (pr(y)) being the probability distribution function (PDF) of the system (reservoir). As the internal energies change due to the interaction, we may define the work and heat by the decrease of the interaction energy, i.e., dWs + dWr + dQs + dQr = −d ⟨HI(z)⟩, where ⟨HI(z)⟩ = ∫p(z)HI(z)d z is the ensemble average of the interaction, with p(z) being the PDF of the composite system. In quantum thermodynamics, the work is usually defined as an uncorrelated quantity,[36] i.e., dWs + dWr = −d ⟨HI(z)⟩unc, with ⟨HI(z)⟩unc = ⟨ΘssΘrr. So, the work done on the system and the reservoir can be written, respectively, as

Correspondingly, the heat is defined as a correlated quantity, i.e., dQs + dQr = −[d⟨HI(z)⟩ −d ⟨HI(z)⟩unc], which, after some algebra, is rewritten as dQs + d Qr = d ⟨Hs(x)⟩ + d ⟨Hr(y)⟩ + d ⟨HI(z)⟩unc. As a result, the heat transferred to the system and to the reservoir can be defined, respectively, as
For our purpose as clarified later, we rewrite the heat dissipated to the reservoir in a finite process as
where δ Qr = ∫ ⟨Θrrd ⟨Θss is the correction of the heat at strong coupling with respect to the weak coupling case. This correction can be understood as a negative work done on the reservoir under the requirement of the first law of thermodynamics.

Based on the ensemble results as above, we can straightforwardly define work and heat on the trajectory level. The work done on the system and its reservoir are given, respectively, by

and the heat transferred to the system and its reservoir are, respectively,
Similar to the ensemble result, the heat transferred to the reservoir can be rewritten as
where δ qr = ∫Θr(y)d ⟨Θss represents the heat correction at strong coupling with respect to the weak coupling case. Obviously, the first law of thermodynamics is also satisfied at trajectory level.

Now we discuss a property of the heat under the time reversal. In our case, the time reversal means that both the control parameter and time are all reversed. The time reversed control parameter means that λλ (t) → λ0 in the reverse process. As the Liouville equation is invariant under the time reversal, the PDF keeps unchanged in both the forward and reverse processes, i.e., and .[37] As a result, the heat is an odd function under the time reversal.

3. FT of informational EP

We consider the FT of informational EP from the microscopically reversible dynamics. As the composite system is isolated, the microscopical reversibility means

where PF[z(t)|λ(t)] describes the PDF of the composite system evolving along a trajectory z(t) when the control parameter λ(t) is given by the forward protocol, while is the PDF of the corresponding time reverse trajectory, as presented in Appendix A.

Under the above reversible condition, we can obtain an FT of informational EP. In stochastic thermodynamics the stochastic entropy is defined as s = −ln p, where p is the probability. Using this definition we can define the informational EP as

where ( ) and ps (pr) are the initial and final PDFs of the system (the reservoir). This EP measures the entropy change of the total system, which, as clarified in the following, will be coincided with thermodynamic EP (defined later) if the coupling is weak and the reservoir remains in a Gibbs state. From the reversibility of the PDF, i.e., and , we obtain that both the final PDFs of the forward process are the same as the initial ones of the reverse process, i.e., and , and vice versa. Under this condition, the informational EP is obviously an odd function, i.e., , where ( ) is the informational EP in a forward (reverse) process. As a result, we obtain
where ( ) is the probability of observing a particular value of the informational EP in a forward (reverse) process (see Appendix A for more details). Equation (11) is formally identical to a previously presented thermodynamic EP at weak coupling.[9] This implies that the informational EP could be employed for both weak coupling and strong coupling cases.

Using the above results, we obtain an integral FT, which is actually another form of the second law of thermodynamics from the viewpoint of information. If we denote the ensemble average by ⟨e−Σinf⟩ = ∫e−Σinf PF(Σinf)d Σinf, then from Eq. (11) we have

which means that the averaged informational EP is never negative, i.e., ⟨Σinf⟩ ≥ 0. This also implies that the informational EP can be used to indicate the direction of the thermodynamic evolution, even in the strong coupling case.

4. FT of thermodynamic EP

In stochastic thermodynamics, the thermodynamic EP is defined as[39] Assuming the reservoir initially in a Gibbs state, i.e., , with Zr = ∫ exp [−β Hr(y0)]d y0 being partition function, which has always been assumed in studying the second law of thermodynamics, we obtain the entropy change of the reservoir as

where is the entropy difference between the two distributions pr and . This entropy difference describes the deviation from thermal equilibrium of the reservoir. Then Eq. (13) turns to be a relation between the two EPs,
where the last two terms on the right-hand side of the above equality appear due to the strong coupling. In weak coupling limit with the reservoir in a thermal equilibrium state, Eq. (15) is reduced to Σinf = Σtherm due to and δ qr = 0.

If the reservoir is driven out of the thermal equilibrium, i.e., in a non-Gibbs state, but δ qr is still zero, we obtain, from Eqs. (10) and (15), the FT of the thermodynamic EP as follows:

where represents the probability of observing a particular value of the thermodynamic EP in a reverse process with the initial distribution being (see Appendix B for details). From this result we reach an integral FT as
which indicates the same fluctuation for both the EPs. In other words, these two kinds of EPs are equivalent in measuring the irreversibility in this case, which also implies that the thermodynamic EP could be employed even in the case out of the thermal equilibrium of the reservoir.

However, the thermodynamic EP does not work in the strong coupling case. Different from Eq. (17), FT at strong coupling can be written as

where the factor γ, different from unity, is given by
as derived in Appendix B. Moreover, equation (18) can be rewritten as a generalized FT, i.e.,
where the new term κ = ln γ is due to the nonzero negative work done on the reservoir at strong coupling. This form is very similar to a previous result obtained in a nonequilibrium system subject to a feedback control, where the new term κ is replaced by the mutual information obtained by measurements.[38] In fact, measurements yield the same effects on the system as the reservoir, which implies that the term κ plays the same role as the feedback control.

More importantly, appearance of the factor κ also implies that the second law of thermodynamics as expressed by the thermodynamic EP may be violated, i.e., ⟨Σtherm⟩ ≤ 0. To further clarify this point, we exemplify a special case that the heat correction in a system has a saddle point in the paths with all possible initial points in the total phase space. As a result, Eq. (18) can be approximated as[40]

where in the first line we have used the fact that the main contribution in the integral comes from the neighborhood of the saddle point, and in the second equality we have considered Eq. (B7) whose integral with respect to Σtherm is equal to 1. Thus δ q′ is the heat correction at the saddle point. In this context, we find that the ensemble average of the heat correction δ Qr is of the same order of magnitude as the heat correction δ q′. To be more clarified, we plot Fig. 1 to show the possible region given by Eq. (21) for the negative thermodynamic EP, i.e., δ q′ ∈ [−∞,0].

Fig. 1. The factor γ with respect to the heat correction δ q′. In the interval δ q′ ∈ (−∞,0], the case of γ >1 implies the negative thermodynamic FT.

In fact, we can give a more exact condition under which the above-mentioned violation occurs. For this purpose, we consider a second-law lemma. By applying the Liouville equation of the composite system followed by partial integration, we find that the Shannon entropy of the composite system is a constant, i.e., . If the PDFs of the system and reservoir are initially uncorrelated, the Shannon entropy is additive, i.e., . As a result, we obtain the following second-law lemma

where is assumed. The term I = Ss + SrSsr is the mutual information at the final time, where the entropy of the system (reservoir) Ss = −∑ ps(x)ln ps(x) (Sr = −∑ pr(y)ln pr(y)) is the Shannon entropy of the system (reservoir) and also the ensemble average of the corresponding stochastic entropy. Similarly, Ssr = −∑ p(z)ln p(z) is the Shannon entropy of the composite system. Under the condition that the reservoir is initially in a Gibbs state, i.e., Δ Sr = −∑ pr(y)ln pr(y) − βHr(y0)⟩ − ln Zr, we employ the ensemble average of the thermodynamic EP as
and we have
Combining Eqs. (22), (23) with Eq. (24), we obtain
where the term
is a relative entropy. As a result, the sufficient condition of the violation is
which may be satisfied at strong coupling. It implies that the thermodynamic EP is invalidated due to the heat correction, rather than the nonequilibrium effect from the thermal reservoir.

The above results indicate that the thermodynamic EP should be replaced by the informational EP in the strong coupling case in order to satisfy the second law of thermodynamics. We notice that information is introduced into the thermodynamics when we consider a thermodynamic process subject to quantum mechanics.[41] However, different from violation of thermodynamic laws due to quantum correlation involved,[42,43] the violation of the second law of thermodynamics in our case is due to the new definition of work and heat. More specifically, we are treating a purely classical situation, but in the strong coupling case effects regarding the reservoir should be seriously considered. The heat correction due to strong coupling, which is from the negative work on the reservoir, is more important than the nonequilibrium effect from the thermal reservoir in the difference between the thermodynamic EP and the informational EP.

5. Conclusions

In summary, we have explored the FT of entropy production in the case of the strong system–reservoir coupling by redefining heat and work to be trajectory-dependent. In comparison with previous definition regarding the changes of the corresponding state parameters, our definition is consistent with the concept of the thermodynamics. We have compared the informational EP with the thermodynamic EP, and presented a generalized FT of the thermodynamic EP. We have also found that, due to non-zero negative work on the reservoir in the strong coupling case, the thermodynamic EP should be replaced by the informational EP in order to keep the second law of thermodynamics satisfied. These results would be helpful for understanding thermodynamic behavior in the strong coupling situation, particularly for example, for the effects from the reservoir on the observation.

Reference
[1] Evans D J Cohen E G D Morriss G P 1993 Phys. Rev. Lett. 71 2401
[2] Evans D J Searles D J 1994 Phys. Rev. 50 1645
[3] Evans D J Searles D J 2002 Adv. Phys. 51 1529
[4] Jarzynski C 2011 Annu. Rev. Condens. Matter Phys. 2 329
[5] Jarzynski C 1997 Phys. Rev. Lett. 78 2690
[6] Shiraishi N Sagawa T 2015 Phys. Rev. 91 012130
[7] Deffner S Lutz E 2011 Phys. Rev. Lett. 107 140404
[8] Hatano T Sasa S 2001 Phys. Rev. Lett. 86 3463
[9] Crooks G E 1999 Phys. Rev. 60 2721
[10] Jarzynski C 2000 J. Stat. Phys. 98 77
[11] Maragakis P Spichty M Karplus M 2008 J. Phys. Chem. 112 6168
[12] Hoang T M Pan R Ahn J Bang J Quan H T Li T C 2018 Phys. Rev. Lett. 120 080602
[13] Potts P P Samuelsson P 2018 Phys. Rev. Lett. 121 210603
[14] Wang M Huang S Y Hu R Luo X B 2019 Chin. Phys. 28 087804
[15] Hu R Zhou S L Li Y Lei D Y Luo X B Qiu C W 2018 Adv. Mater. 30 1707237
[16] Hu R Huang S Y Wang M Luo X B Shiomi J Qiu C W 2019 Adv. Mater. 31 1807849
[17] Campisi M Hänggi P Talkner P 2016 Phys. Rev. 94 022143
[18] Åerg J 2018 Phys. Rev. X 8 011019
[19] Manzano G Horowitz J M Parrondo J M R 2018 Phys. Rev. X 8 031037
[20] Vinjanampathy S Anders J 2016 Contemp. Phys. 57 1
[21] Liphardt J Dumont S Smith S B Tinoco I Bustamante C 2002 Science 296 1832
[22] Toyabe S Sagawa T Ueda M Muneyuki E Sano M 2010 Nat. Phys. 6 988
[23] Koski J V Maisi V F Sagawa T Pekola J P 2014 Phys. Rev. Lett. 113 030601
[24] An S Zhang J N Um M Lv D Lu Y Zhang J Yin Z Q Quan H T Kim K 2015 Nat. Phys. 11 193
[25] Xiong T P Yan L L Zhou F Rehan K Liang D F Chen L Yang W L Ma Z H Feng M Vedral V 2018 Phys. Rev. Lett. 120 010601
[26] Gallego R Riera A Eisert J 2014 New J. Phys. 16 125009
[27] Seifert U 2016 Phys. Rev. Lett. 116 020601
[28] Talkner P Hänggi P 2016 Phys. Rev. 94 022143
[29] Jarzynski C 2017 Phys. Rev. 7 011008
[30] Newman D Mintert F Nazir A 2017 Phys. Rev. 95 032139
[31] Hänggi P Talkner P Borkovec M 1990 Rev. Mod. Phys. 62 251
[32] Campisi M Talkner P Hänggi P 2009 Phys. Rev. Lett. 102 210401
[33] Fermi E 1936 Thermodynamics New York Dover Publications INC.
[34] Bochkov G N Kuzovlev Y E 1977 Sov. Phys. JETP 45 125
[35] Bochkov G N Kuzovlev Y E 1981 Physica 106 443
[36] Weimer H Henrich M J Rempp F Schröder H Mahler G 2008 Europhys. Lett. 83 30008
[37] Parrondo J M R Van den Broeck C Kawai R 2009 New J. Phys. 11 073008
[38] Sagawa T Ueda M 2010 Phys. Rev. Lett. 104 090602
[39] Seifert U 2005 Phys. Rev. Lett. 95 040602
[40] Copson E T 2004 Asymptotic Expansions Cambridge Cambridge University Press
[41] Parrondo J M R Horowitz J M Sagawa T 2015 Nat. Phys. 11 131
[42] Rio L Åberg J Renner R Dahlsten O Vedral V 2011 Nature 474 61
[43] Bera M N Riera A Lewenstein M Winter A 2017 Nat. Commun. 8 2180